It's a matter of trust: exploring the basis of program directors' decisions about whether to trust a resident to care for a loved one.

There has been increased attention to and emphasis on competency-based medical education and the transformation from highly supervised medical students towards independent, entrustable physicians. We explored how program directors (PDs) justify decisions about whether they would trust finishing Post Graduate Year 1 (PGY1) residents to care for the PD or a loved one. Using an end of year survey with validity evidence, we assessed PDs' responses (Yes, No, Not Sure) and written comments about this entrustment decision for USUHS medical students from graduating classes of 2013-2015 (PGY1). We performed a qualitative inductive content analysis to identify themes in how PDs justified their decisions as well as descriptive statistics and a contingency table analysis to examine associations between trust decisions and election to membership in Alpha Omega Alpha (AOA), or conversely, referral to the Student Promotions Committee (SPC) for remediation. Qualitative analyses revealed five themes related to this trust decision about medical residents: personal, interpersonal, knowledge, competence, and developmental. Neither AOA status, nor SPC referral status was significantly associated with the trust measure, overall, but positive trust decisions were significantly higher among those elected to AOA than in those who were not. Positive trust decisions were significantly associated with AOA status but negative trust decisions were not significantly associated with referral to the SPC. This study offers insights into what attributes may underpin trust decisions by PDs. Our findings suggest that PDs' frequent use of personal and interpersonal characteristics to justify trust decisions contrasts with the use of clinical and knowledge based assessments during undergraduate medical education (UME), and emphasize the importance of critical intrinsic abilities.

Post-Carnegie II curricular reform: a north American survey of emerging trends & challenges.

BACKGROUND: In 2010, coincident with the 100th anniversary of Flexner's sentinel report, the Carnegie Foundation published an updated review of North American medical education and challenged medical schools to initiate further educational reforms. Specific recommendations pertained to a) ensuring standardized outcomes while allowing for individualized processes, b) integrating foundational knowledge with clinical experience, c) cultivating habits of inquiry and innovation and d) professional identity formation. As we approach the 10-year anniversary of this latest report, we sought to determine what type of curricular revisions have been emerging within the past decade and what types of challenges have been encountered along the way? METHODS: In 2018, an electronic survey was sent to all 166 Liaison Committee on Medical Education (LCME) accredited North American Medical Schools, using the points of contact (educational deans) that were listed in a publicly available, Association of American Medical Colleges database. Free text comments were grouped into themes using the constant-comparative technique. RESULTS: Sixty unique responses yielding a 36.14% response rate. The distribution of responses was proportionally representative of the distribution of public vs. private, old vs. new vs. established North American medical schools. Self-reported curricular changes aggregated into five main themes: Changes in curricular structure/organization, changes in curricular content, changes in curricular delivery, changes in assessment, and changes involving increased use of technology/informatics. Challenges were predominantly focused on overcoming faculty resistance, faculty development, securing adequate resourcing, change management, and competition for limited amounts of curricular time. CONCLUSIONS: Changes in curricular organization, content, delivery, assessment and the use of technology reflect reforms that are broad and deep. Empowering faculty to "let go" of familiar constructs/processes requires strong leadership, particularly when initiating particularly disruptive curricular changes, such as relocating the Step 1 examination or shifting to a competency-based curriculum. While North American medical schools are responding to the calls for action described in the second (2010) Carnegie Foundation report, the full vision has yet to be achieved.

Combination of anti-citrullinated protein antibodies and rheumatoid factor is associated with increased systemic inflammatory mediators and more rapid progression from preclinical to clinical rheumatoid arthritis.

The development of rheumatoid factor (RF) and/or anti-citrullinated protein antibodies (ACPAs) can be observed years prior to clinical diagnosis of rheumatoid arthritis (RA). Nevertheless, the interaction between these two autoantibodies and their combined effect on development of RA is unclear. We measured RF, cytokines, and ACPA subtypes in serial pre-clinical serum samples collected from 83 US veterans who all developed RA. Levels of cytokines and ACPAs were compared between the following groups: anti-cyclic citrullinated peptide (anti-CCP)-/RF- (double negative), anti-CCP+/RF-, anti-CCP-/RF+, or anti-CCP+/RF+ (double-positive). The double-positive subgroup had significantly higher levels of 20 inflammatory cytokines and 29 ACPA reactivities, and the shortest interval, 1.3 years, between the preclinical sample timepoint and diagnosis of RA. Thus, the combined presence of ACPAs and RF is associated with a more rapid progression to RA, suggesting that anti-CCP+/RF+ individuals have a more advanced preclinical disease state and that the onset of RA may be imminent.

A Longitudinal Study of Commonly Used Admissions Measures and Disenrollment from Medical School and Graduate Medical Education Probation or Termination from Training.

Introduction: This is an empirical study to better understand commonly used medical school admission measures and disenrollment decisions during undergraduate medical education as well as graduate medical education (GME) probation or termination decisions. Materials and Methods: Based on the data of USUHS medical students matriculating between 1998 and 2011 (N = 2,460), we compared medical school graduates and those disenrolled from medical school on MCAT scores, undergraduate BCPM (Biology, Chemistry, Physics, Math) GPA, and undergraduate overall GPA. We also reported more specific reasons for disenrollment decisions. Next, we compared the students who were referred to the student promotion committee (SPC) with other students on these measures. Moving onto GME, we compared trainees who were put on probation or terminated from training with those who were not on MCAT and undergraduate GPA measures. In addition, we examined the association between being referred to the SPC and GME probation or termination. Results: There were 2,347 graduates and 113 disenrolled students from medical school (4.8%). For the disenrolled students, 43 (38.7%) students were disenrolled for exclusively (or primarily) non-academic reasons, and 68 (61.3%) were disenrolled for exclusively (or primarily) academic reasons. The t-tests showed statistically significant differences on the MCAT score of the first attempt (t(2,449) = 7.22, P < 0.01, Cohen's d = 0.70), average MCAT score (t(2,449) = 4.22, P < 0.01, Cohen's d = 0.41), and highest MCAT score (t(2,449) = 3.51, P < 0.01, Cohen's d = 0.34). Logistic regression model selection also revealed that the best predictor for disenrollment was the first MCAT score (exp(b) = 0.83, 95% CI = (0.78, 0.88)). No significant differences on these measures were found from the group comparisons on SPC and GME probation or termination. There was no significant association between SPC appearance and GME probation or termination. Conclusions: Academic difficulties, especially in the basic sciences, appear to be the most common factor for disenrollment from medical school. These students also had lower MCAT scores, particularly on the first attempt. The MCAT performance indicators and undergraduate GPA were consistently lower, but not statistically significant, for those who appeared before SPC or were put on probation or terminated from training during GME.

Anthrax Vaccine and the Risk of Rheumatoid Arthritis and Systemic Lupus Erythematosus in the U.S. Military: A Case-Control Study.

U.S. military personnel assigned to areas deemed to be at high risk for anthrax attack receive Anthrax Vaccine Adsorbed (AVA). Few cases of rheumatoid arthritis (RA) and systemic lupus erythematosus (SLE) have been reported in persons who received AVA. Using a matched case-control study design, we assessed the relationship of RA and SLE with AVA vaccination using the Defense Medical Surveillance System. We identified potential cases using International Classification of Diseases, 9th Revision, Clinical Modification codes and confirmed cases with medical record review and rheumatologist adjudication. Using conditional logistic regression, we estimated odds ratios (OR) for AVA exposure during time intervals ranging from 90 to 1,095 days before disease onset. Among 77 RA cases, 13 (17%) had ever received AVA. RA cases were no more likely than controls to have received AVA when looking back 1,095 days (OR: 1.03; 95% confidence interval [CI]: 0.48-2.19) but had greater odds of exposure in the prior 90 days (OR: 3.93; 95% CI: 1.08-14.27). Among the 39 SLE cases, 5 (13%) had ever received AVA; no significant difference in receipt of AVA was found when compared with controls (OR: 0.91; 95% CI: 0.26-3.25). AVA was associated with recent onset RA, but did not increase the risk of developing RA in the long term.

America's medical school: 5,000 graduates since the "first class".

In 1980, the Uniformed Services University of the Health Sciences (USU) graduated its first class of medical students. As a national university intended to produce "career-committed" military officers and future leaders of the Military Health System, USU functions as the service academy for military medicine and public health. More than 40 years after the school's charter and 5,000 graduates since the first class, we describe the original purpose of USU and provide an update on its achievements. In particular, we address the question of the "staying power" of the University's alumni-the degree to which graduation from the nation's military medical school is associated with long years of devoted service to military medicine. At a time when the MHS is confronting the challenge of extended deployments, rising health care costs, and a growing array of threats to our nation's health, we suggest that America needs USU now more than ever.

Are commonly used premedical school or medical school measures associated with board certification?

PURPOSE: To determine if there is an association between several commonly obtained premedical school and medical school measures and board certification performance. We specifically included measures from our institution for which we have predictive validity evidence into the internship year. We hypothesized that board certification would be most likely to be associated with clinical measures of performance during medical school, and with scores on standardized tests, whether before or during medical school. METHODS: Achieving board certification in an American Board of Medical Specialties specialty was used as our outcome measure for a 7-year cohort of graduates (1995-2002). Age at matriculation, Medical College Admissions Test (MCAT) score, undergraduate college grade point average (GPA), undergraduate college science GPA, Uniformed Services University (USU) cumulative GPA, USU preclerkship GPA, USU clerkship year GPA, departmental competency committee evaluation, Internal Medicine (IM) clerkship clinical performance rating (points), IM total clerkship points, history of Student Promotion Committee review, and United States Medical Licensing Examination (USMLE) Step 1 score and USMLE Step 2 clinical knowledge score were associated with this outcome. RESULTS: Ninety-three of 1,155 graduates were not certified, resulting in an average rate of board certification of 91.9% for the study cohort. Significant small correlations were found between board certification and IM clerkship points (r = 0.117), IM clerkship grade (r = 0.108), clerkship year GPA (r = 0.078), undergraduate college science GPA (r = 0.072), preclerkship GPA and medical school GPA (r = 0.068 for both), USMLE Step 1 (r = 0.066), undergraduate college total GPA (r = 0.062), and age at matriculation (r = -0.061). In comparing the two groups (board certified and not board certified cohorts), significant differences were seen for all included variables with the exception of MCAT and USMLE Step 2 clinical knowledge scores. All the variables put together could explain 4.1% of the variance of board certification by logistic regression. CONCLUSIONS: This investigation provides some additional validity evidence that measures collected for purposes of student evaluation before and during medical school are warranted.

Development and initial validation of a program director's evaluation form for third-year residents.

BACKGROUND: Using a previously developed postgraduate year (PGY)-1 program director's evaluation survey, we developed a parallel form to assess more senior residents (PGY-3). The PGY-3 survey, which aligns with the core competencies established by the Accreditation Council for Graduate Medical Education, also includes items that reflect our institution's military-unique context. PURPOSE: To collect feasibility, reliability, and validity evidence for the new PGY-3 evaluation. METHODS: We collected PGY-3 data from program directors who oversee the education of military residents. The current study's cohort consisted of Uniformed Services University of the Health Sciences students graduating in 2008, 2009, and 2010. We performed exploratory factor analysis (EFA) to examine the internal structure of the survey and subjected each of the factors identified in the EFA to an internal consistency reliability analysis. We then performed correlation analysis to examine the relationships between PGY-3 ratings and several OUTCOMES: PGY-1 ratings, cumulative medical school grade point average (GPA), and performance on U.S. Medical Licensing Examinations (USMLE) Step 1, Step 2 Clinical Knowledge, and Step 3. RESULTS: Of the 510 surveys we distributed, 388 (76%) were returned. Results from the EFA suggested four factors: "Medical Expertise," "Professionalism," "Military-unique Practice," and "Systems-based Practice." Scores on these four factors showed good internal consistency reliability, as measured by Cronbach's α (α ranged from 0.92 to 0.98). Further, as expected, "Medical Expertise" and "Professionalism" had small to moderate correlations with cumulative medical school GPA and performance on the USMLE Step examinations. CONCLUSIONS: The new program director's evaluation survey instrument developed in this study appears to be feasible, and the scores that emerged have reasonable evidence of reliability and validity in a sample of third-year residents.

Development and initial validation of a program director's evaluation form for medical school graduates.

BACKGROUND: In the early 1990 s, our group of interdepartmental academicians at the Uniformed Services University (USU) developed a PGY-1 (postgraduate year 1) program director evaluation form. Recently, we have revised it to better align with the core competencies established by the Accreditation Council for Graduate Medical Education. We also included items that reflected USU's military-unique context. PURPOSE: To collect feasibility, reliability, and validity evidence for our revised survey. METHOD: We collected PGY-1 data from program directors (PD) who oversee the training of military medical trainees. The cohort of the present study consisted of USU students graduating in 2010 and 2011. We performed exploratory factor analysis (EFA) to examine the factorial validity of the survey scores and subjected each of the factors identified in the EFA to an internal consistency reliability analysis. We then performed correlation analysis to examine the relationship between PD ratings and students' medical school grade point averages (GPAs) and performance on U.S. Medical Licensing Examinations Step assessments. RESULTS: Five factors emerged from the EFA--Medical Expertise, Military-unique Practice, Professionalism, System-based Practice, and Communication and Interpersonal Skills." The evaluation form also showed good reliability and feasibility. All five factors were more strongly associated with students' GPA in the initial clerkship year than the first 2 years. Further, these factors showed stronger correlations with students' performance on Step 3 than other Step Examinations. CONCLUSIONS: The revised PD evaluation form seemed to be a valid and reliable tool to gauge medical graduates' first-year internship performance.

Career accomplishments of Uniformed Services University of the Health Sciences medical graduates: classes 1980-2001.

PURPOSE: To report accomplishments of graduates of the F. Edward Hébert School of Medicine who have left, retired, or are near the end of their uniformed career in several professional domains: military career milestones, medical professional education, academic landmarks, and leadership. METHODS: This study utilized an earlier questionnaire that was modified to capture additional career landmarks and improve the clarity of several items. The modified survey was sent electronically to alumni who graduated from 1980-2001 in March, 2012. RESULTS: The questionnaire was sent to 2,825 alumni for whom we had e-mail addresses. We estimate that we reached 2,400 alumni. A total of 1,189 alumni returned the questionnaire, yielding an estimated response rate of 50%. For this cohort, the board certification was 95%, over 20% obtained additional degrees, 92.8% had worked as a full-time physician, nearly two-thirds had deployed for combat, 13.9% had received the Legion of Merit, and 68.6% had published at least one peer-reviewed manuscript. CONCLUSION: Many accomplishments including board certification rates, deployment experience, academic and military leadership positions, military awards, promotion rates, and academic medicine contributions are indicators that USU is continuing to meet its unique mission.

Assessing curriculum effectiveness: a survey of Uniformed Services University medical school graduates.

PURPOSE: This study assessed alumni perceptions of their preparedness for clinical practice using the Accreditation Council for Graduate Medical Education (ACGME) competencies. We hypothesized that our alumni's perception of preparedness would be highest for military-unique practice and professionalism and lowest for system-based practice and practice-based learning and improvement. METHOD: 1,189 alumni who graduated from the Uniformed Services University (USU) between 1980 and 2001 completed a survey modeled to assess the ACGME competencies on a 5-point, Likert-type scale. Specifically, self-reports of competencies related to patient care, communication and interpersonal skills, medical knowledge, professionalism, systems-based practice, practice-based learning and improvement, and military-unique practice were evaluated. RESULTS: Consistent with our expectations as the nation's military medical school, our graduates were most confident in their preparedness for military-unique practice, which included items assessing military leadership (M = 4.30, SD = 0.65). USU graduates also indicated being well prepared for the challenges of residency education in the domain of professionalism (M = 4.02, SD = 0.72). Self-reports were also high for competencies related to patient care (M = 3.86, SD = 0.68), communication and interpersonal skills (M = 3.88, SD = 0.66), and medical knowledge (M = 3.78, SD = 0.73). Consistent with expectations, systems-based practice (M = 3.50, SD = 0.70) and practice-based learning and improvement (M = 3.57, SD = 0.62) were the lowest rated competencies, although self-reported preparedness was still quite high. DISCUSSION: Our findings suggest that, from the perspective of our graduates, USU is providing both an effective military-unique curriculum and is preparing trainees for residency training. Further, these results support the notion that graduates are prepared to lead and to practice medicine in austere environments. Compared to other competencies that were assessed, self-ratings for systems-based practice and practice-based learning and improvement were the lowest, which suggests the need to continue to improve USU education in these areas.

The long-term career outcome study: lessons learned and implications for educational practice.

The work of the Long-Term Career Outcome Study has been a program of scholarship spanning 10 years. Borrowing from established quality assurance literature, the Long-Term Career Outcome Study team has organized its scholarship into three phases; before medical school, during medical school, and after medical school. The purpose of this commentary is to address two fundamental questions: (1) what has been learned? and (2) how does this knowledge translate to educational practice and policy now and into the future? We believe that answers to these questions are relevant not only to our institution but also to other educational institutions seeking to provide high-quality health professions education.

Anti-carbamylated protein antibodies are present prior to rheumatoid arthritis and are associated with its future diagnosis.

OBJECTIVE: Anti-carbamylated protein (anti-CarP) antibodies could further elucidate early rheumatoid arthritis (RA) pathogenesis and predict clinical disease. We compared the diagnostic accuracy of anti-CarP antibodies for future RA to other RA-related antibodies in military personnel. METHODS: Stored pre-RA diagnosis serum samples from 76 RA cases were tested for anti-CarP fetal calf serum (FCS), anti-CarP fibrinogen (Fib), anticyclic citrullinated peptide antibodies version 2 (anti-CCP2), rheumatoid factor-nephelometry (RF-Neph), and RF isotypes [immunoglobulin M (IgM), IgG, and IgA]. Positivity for all antibodies was determined as ≥ 2 SD of log-transformed means from controls. Relationships between autoantibodies and future RA were assessed in prediagnosis serum for all RA cases compared to controls using sensitivity, specificity, and logistic regression. Differences in diagnostic accuracy between antibody combinations were assessed using comparisons of area under the curves (AUC). RESULTS: Anti-CarP-FCS was 26% sensitive and 95% specific for future RA, whereas anti-CarP-Fib was 16% sensitive and 95% specific for future RA. Anti-CarP-FCS positivity was associated with future RA, while anti-CarP-Fib trended toward association. The antibody combination of anti-CCP2 and/or ≥ 2 RF (RF-Neph and/or RF-isotypes) resulted in an AUC of 0.72 for future RA, where the AUC was 0.71 with the addition of anti-CarP-FCS to this prior combination. CONCLUSION: Adding anti-CarP-FCS to antibody combinations did not improve AUC. However, anti-CarP-FCS was associated with future onset of RA, and was present in prediagnosis serum in ∼10% of RA cases negative for anti-CCP2 but positive for RF.

Validity evidence for medical school OSCEs: associations with USMLE® step assessments.

BACKGROUND: Recently, there has been a surge in the use of objective structured clinical examinations (OSCEs) at medical schools around the world, and with this growth has come the concomitant need to validate such assessments. PURPOSES: The current study examined the associations between student performance on several school-level clinical skills and knowledge assessments, including two OSCEs, the National Board of Medical Examiners® (NBME) Subject Examinations, and the United States Medical Licensing Examination® (USMLE) Step 2 Clinical Skills (CS) and Step 3 assessments. METHODS: The sample consisted of 806 medical students from the Uniformed Services University of the Health Sciences. We conducted Pearson correlation analysis as well as stepwise multiple linear regression modeling to examine the strength of associations between students' performance on 2nd- and 3rd-year OSCEs and their two Step 2 CS component scores and Step 3 scores. RESULTS: Positive associations were found between the OSCE variables and the USMLE scores; in particular, student performance on both the 2nd- and 3rd-year OSCEs was more strongly associated with the two Step 2 CS component scores than with Step 3 scores. CONCLUSIONS: These findings, although preliminary, provide some predictive validity evidence for the use of OSCEs in determining readiness of medical students for clinical practice and licensure.

What aspects of letters of recommendation predict performance in medical school? Findings from one institution.

PURPOSE: To study medical students' letters of recommendation (LORs) from their applications to medical school to determine whether these predicted medical school performance, because many researchers have questioned LORs' predictive validity. METHOD: A retrospective cohort study of three consecutive graduating classes (2007-2009) at the Uniformed Services University of the Health Sciences was performed. In each class, the 27 students who had been elected into the Alpha Omega Alpha (AOA) Honor Medical Society were defined as top graduates, and the 27 students with the lowest cumulative grade point average (GPA) were designated as "bottom of the class" graduates. For each student, the first three LORs (if available) in the application packet were independently coded by two blinded investigators using a comprehensive list of 76 characteristics. Each characteristic was compared with graduation status (top or bottom of the class), and those with statistical significance related to graduation status were inserted into a logistic regression model, with undergraduate GPA and Medical College Admission Test score included as control variables. RESULTS: Four hundred thirty-seven LORs were included. Of 76 LOR characteristics, 7 were associated with graduation status (P ≤ .05), and 3 remained significant in the regression model. Being rated as "the best" among peers and having an employer or supervisor as the LOR author were associated with induction into AOA, whereas having nonpositive comments was associated with bottom of the class students. CONCLUSIONS: LORs have limited value to admission committees, as very few LOR characteristics predict how students perform during medical school.

Is poor performance on NBME clinical subject examinations associated with a failing score on the USMLE step 3 examination?

PURPOSE: To investigate the association between poor performance on National Board of Medical Examiners clinical subject examinations across six core clerkships and performance on the United States Medical Licensing Examination Step 3 examination. METHOD: In 2012, the authors studied matriculants from the Uniformed Services University of the Health Sciences with available Step 3 scores and subject exam scores on all six clerkships (Classes of 2007-2011, N = 654). Poor performance on subject exams was defined as scoring one standard deviation (SD) or more below the mean using the national norms of the corresponding test year. The association between poor performance on the subject exams and the probability of passing or failing Step 3 was tested using contingency table analyses and logistic regression modeling. RESULTS: Students performing poorly on one subject exam were significantly more likely to fail Step 3 (OR 14.23 [95% CI 1.7-119.3]) compared with students with no subject exam scores that were 1 SD below the mean. Poor performance on more than one subject exam further increased the chances of failing (OR 33.41 [95% CI 4.4-254.2]). This latter group represented 27% of the entire cohort, yet contained 70% of the students who failed Step 3. CONCLUSIONS: These findings suggest that individual schools could benefit from a review of subject exam performance to develop and validate their own criteria for identifying students at risk for failing Step 3.

Application essays and future performance in medical school: are they related?

BACKGROUND: There is a paucity of research on whether application essays are a valid indicator of medical students' future performance. PURPOSE: The goal is to score medical school application essays systematically and examine the correlations between these essay scores and several indicators of student performance during medical school and internship. METHODS: A journalist created a scoring rubric based on the journalism literature and scored 2 required essays of students admitted to our university in 1 year (N = 145). We picked 7 indicators of medical school and internship performance and correlated these measures with overall essay scores: preclinical medical school grade point average (GPA), clinical medical school GPA, cumulative medical school GPA, U.S. Medical Licensing Exam (USMLE) Step 1 and 2 scores, and scores on a program director's evaluation measuring intern professionalism and expertise. We then examined the Pearson and Spearman correlations between essay scores and the outcomes. RESULTS: Essay scores did not vary widely. American Medical College Application Service essay scores ranged from 3.3 to 4.5 (M = 4.11, SD = 0.15), and Uniformed Services University of the Health Sciences essay scores ranged from 2.9 to 4.5 (M = 4.09, SD = 0.17). None of the medical school or internship performance indicators was significantly correlated with the essay scores. CONCLUSIONS: These findings raise questions about the utility of matriculation essays, a resource-intensive admission requirement.

Alternate list matriculants: outcome data from those medical students admitted from the alternate list.

BACKGROUND: Medical schools are increasing class size to meet future health care needs for our nation. This may lead to more students being accepted from an alternate list (vs. primary acceptances). Given these trends, performance outcomes were compared for alternate list matriculants and primary acceptances. Our hypothesis was that those students accepted from an alternate list would perform equally to the primary acceptances on these outcomes. METHOD: We compared medical school performance of students who received a primary recommendation of "accept" and compared them to those who received a recommendation of "alternate" over a 10-year period. Given the small sample size of this alternate list group (N = 23), descriptive statistics are reported. RESULTS: No consistent differences between alternate and primary acceptance matriculants in terms of cumulative medical school grade point average, United States Medical Licensing Examination (USMLE) Step 1 scores and USMLE Step 2 Clinical Knowledge scores were found. Only three alternates (13.0%) were presented to student promotion committee compared to 17.2% for matriculants who were primary acceptances. Three alternates were required to repeat a year (average percentage of 8.7%) compared to 5.6% of matriculants who were primary acceptances. CONCLUSIONS: This observational study provides some reassurance that as long as the qualifications of the applicant pool remain adequate, admissions policies that provide for alternate list acceptances may not produce poorer performing students, at least by our current outcome measures.